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Can Google protect 
free-speech and police 
harmful content? 


Google 


From elections and political propaganda, trolls and gendered 
bigotry, to hate speech and religious extremism, debates 
about who can and should be heard on the internet rage like 
never before. As governments struggle to apply existing 
legislation to the Wild West online, users are asking if the 
openness of the internet should be celebrated after all. 

Bots and troll farms lash out at free thought and controversial 
opinion, while faceless users attack each other without 
empathy. Free speech becomes a social, economic and 
political weapon. Automated technologies lack the 
sophistication to adjudicate effectively. In response, people 
think twice before airing their thoughts aloud, while critique is 
juried under avalanches of automated rebuttals, vitriolic 
attacks and nonsensical rhetoric. As the tech firms struggle 
to deal with the issues, the public and governments grow 
increasingly impatient. 

Yet, amongst all this negativity, seeds of political harmony, 
gender and racial equality, and tolerance are sown on the 
internet Is it possible to have an open and inclusive internet 
while simultaneously limiting political oppression and 
despotism, hate, violence and harassment? Who should be 
responsible for censoring ‘unwanted’ conversation, anyway? 
Governments? Users? Google? 
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This report is the result of several layers of research 
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Desk research (academic and industry studies) 


Cultural trends (Canvas8 Library) + Narrative analysis (Quid) 
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Local cultural leaders 

Dr Peter Chen 

Academic, Australia 

Bia Granja 

Entrepreneur, Brazil 

Joana Breidenbach 

Anthropologist, Germany 

Nobuyuki Hayashi 

Journalist, Japan 


We worked with cultural leaders and 
local observers to deepen our understanding. 


Grant McCracken 

Anthropologist, US. 

A 

Nikhil Pahwa 

Entrepreneur, InTlia 
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Richard Watson 

Futurist, UK 
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We've worked with some leading thinkers in this 
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Free speech in the era of its 
, -. r;. technological amplification 

. • By Jason Pontin,p60 


Jason Pontin 

Journalist and former editor 
in chief of MIT Technology 
Review 



• of World Without 
Mind and former editor of 
The New Republic 
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Dr. Kalev Leetaru 

Senior Fellow at the George 
Washington University 
Center for Cyber & 
Homeland Security 
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1. The importance of free speech 

2. Bad behaviour and censorship online 

3. Fighting back against bad behaviour online 

4. Tech firms - free speech or censorship? 

5. Flow do people want Google to respond to this predicament? 
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The freedom to speak holds the key to our two most valuable 

possession: 


Personal liberty 

And the ability to express 
yourself freely 


ns... 


ollective wellbeing 

And the prevention of harm 


;ely £ 
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but censorship can give governments - and com panies - the 


power to limit the freedom of individuals*! 














Underpinned by the First Amendment and belief in an "equality of status in the 
field of ideas" - the US is especially committed to free speech 1 


tt 



The reason that we only [ban] speech when it's intended to and likely to cause 
imminent violence is because as long as there'4time enough to deliberate and to 
discuss- [there's faith that] the best remedy to evil counsels is good ones, that 
counter-speech is more appropriate than suppression, and that reason will 
ultimately prevail... it's the essence of our constitutional system. 


Jeffrey Rosen, 2016 

? of Free Speech in 


The Deciders: Tl 




odd. Harvard Kennedy School 


2 
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And conversations about the importance of free speech are alive on 

both sides of the political spectrum 


12.5% — 



Source: Quid with Canvas8 analysis. Media analysis of conversations around "free speech" (Google, Apple, 
Facebook, Amazon), Sep to Dec 2018. Focus on US & UK, mainstream media. 
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The internet was also founded on utopian principles of free 

>X^peect^**' 


Google 
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Governments of the Industrial 
from Cyberspace, the new hoi 
past to leave us alone. You 
where we gather. 

John Perry Bari 

A Declaration of the 


pf flesh and steel, I come 
e future, I ask you of the 
us. You have no sovereignty 


This free speech ideal was instilled in the DNA of the Silicon Valley startups 
that now control the majority of our online conversations... 


oogle 


"[Google's] atmosphere of creativity and 
challenge... has helped us provide 
unbiased, accurate and free access to 
information for those who rely on us 
around the world." 


<$r« 



"[Facebook is a tool to create] a more 
honest and transparent dialogue 
around government. [The result will be] 
better solutions to some of the biggest 
problems of our time." 



"[Twitter is] the free speech wing of 
the free speech party 


Larry Page and Sergey Brin 
2004 Founders' IPO Letter 1 


Mark Zuckerberg 

2012 manifesto for investors 2 


CEO Dick Costolo 
2017 3 
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An important US Federal statute from 1996 supports this position of 

neutrality <5 


Under section 230 of the Communications 
Decency Act, tech firms have legal immunity 
from the majority of the content posted on 
their platforms (unlike 'traditional' media 
publications). 

This protection has empowered YouTube, 
Facebook, Twitter and Reddit to create space: 
for free speech without the fear of legal a 

or its financial consequences. 


aces^”^ 

,ctio„ 


say wnat tne global internet would look like 
230 had never become the law of the land.! - 

Would YouTube have even been possible? 


April Glaser, Slate! 
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And the internet has 
certain, unique qualiti 
that have supported 
these ambitions f 





mmunication is fast and frictionless 


Anonymous conflict is possible 
Everyone has a voice 
We meet like-minded people 
Scale is unprecedented 
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This commitment to free, uncensored conversion has had positive 

outcomes... 


The Arab Spring was the the high point of 
positivity - a visceral example of the 
digitalised free speech. 
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Free speech flourished online as governments struggled to contain it 

it 

On the global scale, the internet and the social pi forms have been a wonderful 
boon for free speech. The internet has given platforms to billion of people to 
express themselves and has nypde it almost impossible for governments - even in 
highly controlled nations like C$ina - to control people's speech effectively. 


Jason Pontin 


ations iiKe 


V 
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But recent global events have undermined this utopian narrative 


j ashmir Clashes (IN)| 


Leslie Jones vs Trolls 


US Election 2016 


|Ferguson Unrest| 


Actor Leslie Jones was m JF~ - 
subjected to persistent sexistl 
and racist trolling on Twitter! 
After Jones quit the platform!* 
hhere was extensive media! 
coverage and public ou tcry, and| 
alt-right ringleader Milo! 
Yiannopoulos was thrown off.B 
He responded: “This is the end! 
for Twitter. Anyone who car es! 
about free speech has been^f 
sent a clear message: 'Y ou 1 ! ! 
not welcome on Twitter 


The revelation that 80,000^^B 
posts made by Russian-basedH 
entities were seen by up to 126| 
million Facebook users ahead| 
of the US election revealed the! 
scope and potential impa ct t | 
fake news on democracy.® 
Facebook's Samidh Cha krabartij 

said the Russian entities!_ 

“essentially [used] social med 
|as an information weapon."! 


Facebook and Twitter were®® 

implicated in governmental^^! 
censorship of clashes between^ 
rebels and Indian authorities ini 
Kashmir. The platforms remove"q 
posts and suspended accoun 
about the events, including^^® 
images of rebel Burhan WanTs® 
funeral, highlighting the^^^^! 
platforms' complicity with! 
government censorship as they| 
attempted to stay on the rigl^® 
|side of global authorities.,^ 


Social media coverage of the|| 
Ferguson protests revealed the! 
stark difference between Twitten 
and Facebook's newsfeeds.! 
While the former was filled with! 
blow-by-blow accounts and^^! 
updates on the domestic news! 
story, the ice bucket challenge® 
filled the latter. The discrepancy! 
clarified the power of algorithms^ 
p effectively 'censor' the news! 
by fav ouring some content overj 
others.! 



|But recent global events have undermined this utopian narrative^ 



LOVE IlKTIfF 

JI ILL 




T i 


|Ph ilando Castile! 


■ The aftermath of the sh ooting! 

1 of Philando Castile was| 

I broadcast on Facebook Live.L 
Bwhere traditional media would! 

H ^^have had time to consider howl 
to broadcast such sensi tive! 
violent and controversial! - 
content, live-streaming! 

-(sidesteps this editorial proc ess! 

The clip highlights the huge 
Importance of context in|” 

I eration and the fluctuating! 
|line of appropriate censorship.! 


The rise of far-right political! 
parties and institutions such as! 
Britain First, Germany's AfD andl 
Unite the Right opened peo ple's 
eyes to how alt-right beliefs!” 
lhave been able to flourish on| 
he internet. Once controversial! 
Ivoices have been emboldened! 
by like-minded individuals and| 
are making their way offline,!^ 
both on the streets and at thel 


jueermuseu (BR)| 

The conservative Free Brazil\ 
Movement used social medial 
Iplatforms to rally against an art| 
exhibition called Que ermuseu,r 
|because it discussed^ 
(homosexuality and paedophilia] 
The exhibit was eventually shut| 
|down, raising concerns abouj 
^freedom of expressio n in| ~ 
digital spaces and the|~ 
censorship of o nline/offline 
spaces In Brazil!” 


LoganPauJ 

iHugely popular Youtuber, Logan| 
IPaul drew criticism for an|” 
linsensitive clip of him seeing a 
(suicide victim in Aokig ahar 
Iforest, Japan. Youtube|” 
(responded by removing Paul! 
Ifrom its premium advertising! 
(program and reforming its adl 
(restrictions. The controversy! 
rjraised the question of how much| 
censorship we should demandP 
Jfrom Youtube and whether it is! 
(putting profit before people ! 





















|While revelations and exposes increased calls for change| 

A r 


[Extremist Content! 

iMajor brands, including the UK government! 
|Marks & Spencer and McDonald's, boycotte | 
YouTube after it was revealed that their ads were| 
appearing on controversial clips and extremist! 
content. Google responded with promises of anl 
Dverhaul to advertising policies, including morel 
control and transparency for advertisers, but f ell) 
short of promising to rid the platform of such|~^ 
content entirely, as the latter would place them^ 
jsquarely in the realm of 'curator and censor'.| ~^ 

f \ 


|Peppa Parodies! 


\rticles by the New York Times and writer! 

James Bridle called attention to troubling and| 
■inappropriate video content on YouTube, which| 
is not only accessible to children but often|~ 
argeted at them using popular kids' charac ters! 
like Peppa Pig, Frozen's Elsa and SpidemnanJ - 
land tags to game the platform's algorithms. Thy 
(resulting outcry led to promises of reform f romf 
fouTube and revealed the shor tcomings off " 
Irelying on algorithmic filtering 












As the "we're not responsible for what happens on our platforms" defence 
crumbles, users and advertisers ar^JpSbnding action... 


tt 



We're through the first early utopian period of social media and free speech, we're 
through the middle period, where ther%was ex^jtement about the benefits of 
these platforms, and now we're into a third era where we’ve become more jaded 
about their functionality. Now we're looking t&the networks themselves to 
better manage their owit utility, and there is conversation about governmental 
obligations on these networks as well. 


- Jason Pon 
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1. The importance of free speech 

2. Bad behaviour and censorship online 

3. Fighting back against bad behaviour online 

4. Tech firms - free speech or censorship? 

5. Flow do people want Google to respond to this predicament? 
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The early utopian period of the 
internet has collapsed under the 
weight of bad behaviour.... 


Jason Pontin 


<^4 




Users, Governments 
& Tech firms 
are all behaving badly... 


Google 
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Hate speech 


Although people have long been racist, 
sexist and hateful in many other ways, they 
weren't empowered by the internet to 
recklessly express their views with 
abandon. From film-stars to activists, 
viciousness is aimed at a diverse range of 
users. 


How are users behavinq badly? 


Reprisals and intimidation 


Trolling 



Online and offline worlds are 
more people are physically as 1 
speaking on the net. In 2CH®1 
cartoonist was murdsEpd in JorcHWbr 
mocking Islamist militants' visionwf heaven, 
while a journalist was killed in Myanmar 
using FaceBookto post abOTt corruptio 



By provoking arguments and flaming 
disruption, trolls threaten valuable debate 
and infuriate users. The problem has 
become so rampant that several websites 
have even resorted to removing comments 
entirely. 




-W (A- 



2.6 million 


8 countries 


26% 

tweets contained anti-Semitic 


witnessed murderous reprisals for 


of American users are victims of 

speech during the US presidential 


online speech in 2017 3 


internet trolling 4 

election 1 






Google 
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How are users behaving badly? 


Cyber harassment 


From petty name-calling to more 
threatening behavior, harassment is an 
unwelcome component of life online for all 
too many users. With sustained stalking 
and one-off incidents defining the 
spectrum, some experiences are easier to 


escape than others. 


40 % 


of internet users 
have been harassed online 1 




Cyber racism 

Supremacy, destiny and nationalisr 
Otherness, separation and hostility. Cyber 
racism exists in many guises, but it most 
often describes a "range^f white supremacist 
movements in Europe and North America" 
and "the new horizons the Internet and 


adly- 


Venting 




When they're angry, people vent their 
frustrations. But whereas people used to 
tell friends and family about bad 
experiences, the internet now provides a 
limitless audience for our gripes. As more 
and more people vent, online 


ie new horizons the Internet and digital and more people vent, online 

media hav^ opened' ror them. 2 v ’ conversations fill with anger and nastiness 


"We're stepping off the internet in a 
big way. We have been spreading our 
memes. We have been organising on 
the internet. And now we're conning 
out." 


Daily Stormer (neo-Nazi website), at the 
Charlottesville protests 3 



"Just pick a random, poor, innocent 
idiot on the internet and just attack 
them. Go after them. And find others 
to join you, who are also angry at that 
moment." 

Kalev Leetaru 


Google 
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Why are 


users 


behaving b 






adly? 


£ 


Human beings en masse don’t behave very well. They particularly don't behave 
very well if there aren't clear rule?!, and especially if speech is unaccountable, 
consequence-free, and in many cases anonymous. What happened on these 
networks is that, in the absence of rules and consequences, everyone has 
behaved maximally ly 


[imally badlyr 

°n^ 





^nd the same reasons why t he internet is great for free speech 
[mean it's also primed for bad behaviour.. 








On the net. 



Relentless, 24/7 online conversations 
encourage people to dive-in with their opinion 

before it's too late, even if they're misinformed. 
And because we think with our emotional brain 
before our rational one, instant responses 

amplify emotion-led discourse not thoughtful 
ebate. 

The social norms that hold society together 
and keep people from hurting one another 
offline, shift faster online. It's more tempting 
to be nasty and aggressive when there are no 

warning signals or hurdles to slow people 
down. And because the internet removes 
physical communication barriers, users are 
detached from the effects of their actions 


Google 
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On the net. 



When they can't be seen or found, people are 
more likely to cheat, lie and attack each 
other. Anonymity isn't the full story - group 
dynamics, online cultures, and even the time of 
day can encourage bad behaviour - but the 
r ^opportunity to behave badly without fear of 
repercussion does bring out the worst in 
people This is especially true when we aren't 
forced to empathize 

Offline, we avoid confrontation because it can 
more easily lead to physical harm - but with 
online anonymity, people don't worry so much. 
When we think nobody can see us, we're 
keener to transgress moral norms And the 
ability to have multiple identities enables 
people to say one thing and do another 


Google 
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On the net. 



The 'little guys and girls' can now be heard 

emerging talent, revolutionaries, 
whistleblowers and campaigners. But 

'everyone else' can shout loudly too 

including terrorists, racists, misogynists and 
oppressors. And because "everything looks like 
the New York Times" on the net, it's harder to 
separate fact from fiction, legitimacy from 
illegitimacy, novelty from history, and positivity 
from destructivity. 


When consumers/producers feel like they 
'own' their media platforms, their experiences 
of free speech and censorship feel more 
personal too. They increasingly value their 
ability to speak freely, but also feel personally 
assaulted when confronted through their own 
channels, lashing out more violently when 


Google 
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On the net. 



The internet has united political activists, 
dissidents and like-minded communities of 

all shapes and sizes, including the oppressed 
minorities. On the flip-side, minority groups 
once pushed underground by public opinion 
of their abhorrent views have discovered a 
safer space in which to communicate, 
organise and reach-out to new sympathizers. 

Because the internet helps people to bunker 

down, surrounded by similar opinions, 
mindsets and behaviours, opportunities for 
learning and life-changing experiences are 
threatened. These closed filter bubbles and 
echo chambers make positive and 
transformative political debate less likely, not 
more. 


Google 
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On the net. 



Across the supranational platforms of the net, 

local stories become global events. People 
unite across borders and time zones But this 
global explosion has created a land grab for 
power. 

Regional laws lose their significance and 
influence. Borderless filters aren't relevant 
everywhere - who decides what is or isn't 
censored? Jokes and critique don't always 
translate well Crummy politicians jump on 
the confusion to expand their influence. Users' 
bad behaviour falls between the cracks. 


Google 
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If that's how users are behaving badly... 

XX/ vV 

What about governments? 


According to Freedom House, only a quarter of the world's internet users reside in 
countries where the internet is 'Free from Censorship ’ 1 



‘Free from Censorship' means there are... 

No major obstacles to access 
No onerous restrictions on content 
No serious violations of user rights in the 
form of unchecked surveillance 
No unjust repercussions for legitimate 
speech . 2 

Freedom on the Net 2017 


Google 
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The spectrum of global internet freedoms isn't especially surprising, but.. 






Japan 






77 

Iceland 





Germany 

94 




Brazil 

80 


China 

13 

Cuba 


67 

UK 

Estonia 

94 


21 

Turkey 

44 


76 

Canada 




India 

85 




Russia 

44 

Mexico 69 

61 

USA 

79 


Syria 




Australia 


14 




79 









Least Free 


Most Free 


Google 


Countries are ranked on a 100-point scale based on three broad categories: obstacles to access, limits on content and violations of user rights. 

The higher the score, the more restrictive a country's internet controls. 
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Political interference is on the increase.... 


Online manipulation and disinformation 
influenced elections in more than 18 countries in 
2017, including the US 1 


Despite having a more vibran^ 
diverse online environment than most, 
disinformation and hy^partisan conie 
are having a bigger' 




Google 
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When a Twitter user objected to Trump's 
immigration policy in January 2017, U.S. Customs 
and Border Protection agents responded by asking 
the firm to reveal their identity, before backi 
when Twitter fought them in court. 


In August the Department of Justice 
contacted D reamHost (a hosting company) to 
demand the names of 1.3 million users who had 
visited #D 
website. 1 


And there are worrying signs of new government encroachments 


Google 
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How are 


Bots 

Bots account for more web traffic than 
humans. 1 Governments employ 
impersonators, scraps, spammers and and 
hackers to manipulate conversations, quell 
dissent and discredit information. From 
Washington to Moscow, bots are deployed 
by governments against foreign 
adversaries and domestic opponents. 2 


28.9% 

of all web traffic is estimated to 
come from 'bad bots' 1 


governments behaving badly? 


Troll farms 

With shadowy secrecy, governme 
armies to manipulate online di 
their favour. 3 This fabric, 
silences opponents and critii 
abroad. And the propaganda m^te t more 
difficult to know which opinions are 
and who is really supportive of thos< 
power. 4 



Restrictions and cyber attacks 

Governments are increasingly restricting 
mobile internet services for political gain or 
security reasons. 6 And users were stopped 
from live streaming anti government 
protests in more than nine countries in 
2017. To limited free speech further, states 
are also restricting encryption and virtual 
private networks (VPNs) 7 



448 million 
comments 

posted by users employed by the 
Chinese government to 
impersonate ordinary citizens 5 


34 


countries witnessed cyber 
attacks against government 
critics in 2017 8 


Google 


// Insights Lab 










5 $ 


ft) 


ind p 


The use of paid commentators and political bots to spread government 
propaganda was pioneered by China and Russia but has now gone global. The 
effects of these rapidly spreading^echniques on democracy and civic activism 
are potentially devastate 



Michael J. AbrarndWitz, president of Freedom House 1 


Governments also trying to tighten their grip on political discourse by asking 

Google to censor more and more content 



50.6% of these 
requests relate to 
YouTube and 19.8% 
to Search. 


Total number of content removal requests made to Google by courts 
and governments worldwide 


Google 
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How 


Incubating fake news 

Untrustworthy sources and misinformation 
have thrived on tech platforms. Dubious 
distributors have capitalised on a lack of 
sense-checking and algorithms that reward 


are tech firms behaving badly? 

& 


Ineffective automation 


Commercialized conversation 


Wth 400 hours of video uploaded to Yoi 
and 340,000 tweets 4 sent every minute, it isn't 
surprising that platforms outsour|g 
moderation duties to Al and automation. But 


Shares, likes and clickbait headlines - 
monetized online conversations aren't 
great news for rational debate. And when 
tech firms have an eye on their 



Google 
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In responding to public pressure, tech firms haven't managed the situation 

particularly well, eitl 


a 



I think they've done an incredibly bad job at staying ahead of the public narrative. 

They seemed incredibly reactive and inconsistent as well, which is really 
dangerous... They should've been able to articulate a principle-based approach 
that was fairly applied to everyone, regardless of their political viewpoints... but 
they've really failed to do so... And as revelations have come out, they’ve come to 
seem not only inconsistent, but misguided and sometimes actively dishonest." 

lP W ry 


Jason 


C? 




Google 
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Inconsistent interventions 

Human error by content moderators 
combined with Al that falls short when faced 
with complex context mean that digital 
spaces are rife with user's frustrations about 
removed posts and suspended accounts, 
especially when it seems like plenty of bad 
behaviour is left untouched. 


How are tech firms mismanaging the issues? 


Lack of transparency 


"[Richard] Spencer doesn't get to be a 
verified speaker; Milo gets kicked off, 
but I know plenty of pretty abusive 
feminist users or left wing users, 

expressing themselves in exactly the 
same way that the right is being 
penalised for, who are permitted 

perform certain kinds of speech. 
That's going to get Twitter irv fcw 
trouble." 

Jason Pontin 


The tech platforms' algorithr 
complicated, obscure 
changing. In lieu of satisfac 
for why bad things are ha] 
assume the worse - whether that's that 
Facebook has a liberal bias or that YoutuJ^ 
doesn't care about weeding out bad 







"Some ei#ity complains about a 
major internet company's practices, 

the company claims that its critics 
don't understand how its algorithms 
sort and rank content, and befuddled 
onlookef^ are left to sift through rival 
stories in the press." 


Frank Pasquale, Professor 
of Law, quoted in the FT 1 


Underplaying the issues 


When faced with a scandal, the tech 
platforms have often underplayed the 
scope of the problem until facts prove 
otherwise. They've frustrated users by not 
giving their complaints and fears the 
respect and attention they've deserved, 
creating a picture of ill-informed arrogance. 


"After the election, I made a comment 
that I thought the idea 
misinformation on Facebook 
changed the outcome of the election 
was a crazy idea. Calling that crazy 
was dismissive and I regret it." 


Mark Zuckerberg, quoted in 
the Guardian 2 


Google 
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How are tech firms mismanaging the issues? 


Slow corrections 

From a users' perspective, the tech platforms 
are quick to censor and slow to reinstate 
content that was wrongfully taken down. 
While the platforms can suspend an account 
in an instant, users often endure a slow and 
laborious appeals process, compounding the 
feeling of unfair censorship. 


Global inconsistency 

In a global world, the platforms' stati 
bastions of free speech is hugely und 
by their willingness to bend to requirements of 
foreign repressive governments. When 
platforms compromise their public-facing 
values in order to maintain a global footpryj 
can make them look bad elsewhere 


Jmninea 
ments of 


g the 


Reactionary Tactics 


When a problem emerges, the tech 
platforms seem to take their time and wait 
to see if it's going to blow over before 
wading in with a solution or correction. The 
lag gives users and governments plenty of 
time to point fingers, gather supporters and 
get angrier. 


"Here's the frustrating thing for me as 
someone who uses Facebook: when 
you try to find out what the 
community standards are, there's no 
place to go. They change them 
willy-nilly whenever there's 
controversy. They've made 
themselves so inaccessible." 

£ 

> 

In 2014, the Electronic Frontier 
Inundation said Facebook was 

“complicit in political censorship" for 

restricting content in Turkey and 
Pakistan. 


"What you're seeing is this very 
reactive element. The big tech 
companies tend to kind of sit back 
quietly, wait for big storms to brew. 
They typically sit quietly until it really 
reaches the breaking point, and then 
they engage." 

Janis Ian, quoted in 

Propublica 1 


EEF, 2014 2 


Kalev Leetaru 


Google 
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When it comes to users, all of this bad behaviour and mismanagement... 


our ar 


Impacts trust 




"It’s a nightmare. 

I can’t trust YouTube any more." 

Matan Uziel, who's videos protesting sex 
trafficking and gendered abuse were demonetized 




'ncites criticism 




How a half-educated tech elite 
delivered us into chaos" 


inetized 


aughton, the Guardian 


Increases calls for re*" jla ; on 


"Why we need to regulate the 
tech platforms" 

Rana Forochar, The Financial Times 


ms . 


Breeds conspiracy theories 


"Google's search engine was suppressing 
the bad news about Hillary Clinton" 

Donald Trump, 2016 


Google 


Leaving users feeling powerless, frustrated and confused... 


// Insights Lab 











1. The importance of free speech 

2. Bad behaviour and censorship online 

3. Fighting back against bad behaviour online 

4. Tech firms - free speech or censorship? 

5. Flow do people want Google to respond to this predicament? 
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With so much bad behavior it's not surprising that users and 
governme^ 
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HT BACK 
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Users, Self censorship 


Users are self-censoring to avoid repercussions 


With a growing realisation that content remains on the internet 
'forever' and can be seen by everyone - in addition to the possibility of 
attracting of trolls - people are self-censoring more online. As a result, 
the utopian public sphere envisioned by the internet's founders is 
becoming much less vibrant, especially in spaces where our real 
names are required. 
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TEENS ARE EDITING THEIR SOCIAL 
MEDIA FEEDS BEFORE COLLEGE 


A third of college admissions officers now routinely 
check applicants' social media posts. In response, 
students are 'scrubbing' their accounts in their senior 
year to ensure their Twitter feeds line-up with ‘the best 
self they are peddling in their applications. 





Users, Migration 


Users are migrating to other platforms 


Unhappy with the level of censorship on certain platforms, users are 
emigrating to ones with more - or less - restrictive rules. Twitter, 
which has failed to satisfy either side of the argument fully, has been 
particularly susceptible to this emigration. 


Victims of trolling or those unhappy with toxic atmosphere^p§| I 
leaving Twitter, often for Facebook, which is seen as a more protected 
and controllable space. 


;en Ol_ 




Meanwhile, as Twitter tries to counteract thij^tt|taking on a more 
curatorial and moderatorial role, communities that disagree with t 
changes are moving to less restrictive platforms. 
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#SPEAKFREELY 
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CONTROVERSIAL TWEETERS ARE USING 
CHALLENGER APP GAB 

Twitter once declared itself the "free speech wing of 
the free speech party", but growing criticism of its 
failure to address hate speech means it has pushed 
controversial figures out. Some of those who are now 
unwelcome, such as far-right group Britain First, are 
signing up to challenger site, Gab. 


Users, Protesting 


Google 


Users are protesting bad behaviour 

Empowered by their digital soapboxes, those unhappy with the current 
rules of digital spaces are protesting them. Campaigns are led by 
journalists, academics, celebrities or everyday people, but find their 
power in the support of disgruntled users. 

Individuals have made public protests through art and writing. For 
example, German artist activist Shahak Shapira spray-painted abu 
tweets he had received and reported onto the ground outside tl 
Twitter headquarters. 

Proactive users have also used their collectivetodTaw 
attention to what they perceive as misplaced censorship - such 
#WomenBoycottTwitter after Rose McGoW^fe's^^itter 
disabled. 
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E.g... 

#ichbinhier 

#ichbinhier - which translates to I am Here - is a 
Facebook group created by German man Hannes Ley. 1 
It has 27,000 members and works like a digital 
flash-mob fighting back against hate on the internet 
through friendly counter-commenting on unpleasant 
posts. 




Users, Trust Issues 


Users are (re)turning to trusted sources 

With digital platforms implicated in the spread of 'fake news' and 
misinformation from questionable sources, people are turning to 
mainstream media outlets for trustworthy information. 


The New Yorker, New York Times, Washington Post, the Wall Stree~ 
Journal and the Guardian all saw bumps in subscriptions i 
the biggest growth coming from young people. 



Google 



AFTER HEARING ABOUT 'FAKE NEWS'... 


23 % of people were 

more trusting of printed 
news magazines 





' 58 % of people were less 
trusting of social media's 
political coverage 1 
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Governments, Global rules 


Governments are asserting power over global policy 


As the tech companies have grown more dominant on the global 
stage, their intrinsically American values have come into conflict with 
some of the values and norms of other countries. 


Now, governments are seeking to balance their national values wi 
those of the tech giants through increasingly strong measures. Ar 
because the internet is a global platform, many want those 
nationally-desired protections to be enacted globally - influencing 
the entire internet functions. 


s~ 






> 

\ 


Google 


THE RIGHT TO BE FORGOTTEN 


The European court of justice has already ruled that 
Google has to delete some information from its index 
on request. But France is calling for the law's reach to 
be wider, arguing that it is not a national issue, but a 
global one, and that citizens who win the right to have 
data removed should be granted that right across the 
entire internet. The case would set a precedent for 
how far national governments' powers stretch online. 


Governments, Digital borders 


Governments are fighting back against interference 
from abroad 


There is an increasing awareness that technology platforms can be 
and are - used by foreign governments to influence domestic issues, 
through content manipulation. In reaction, governments are using a 
variety of tactics to suppress such possibilities. 




Some moves - such as the Ukrainian authorities' blocking 
Russia-based services, including the country's most widely us?§jLsglSal 
network and search engine - legally restrict internet freedom, while 
others - such as US Congress questioning Facebook, TwitteiyGoogle 

et al about Russia-backed agents - push the - 

changes in order to pre-empt regulation. 
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US CONGRESS vs RUSSIAN ADS 

The scandal surrounding Russian involvement in the 
2016 US election made it clear how vulnerable to 
outside manipulation the tech platforms are. 

In response, Congress demanded answers of the tech 
platforms, who then implemented new policies to 
make ads more transparent. 
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Governments, Local Laws 


Governments are making digital censorship more like 
offline censorship 


The internet has long been a 'Wild-West' of rules and regulations - with 
all forms of speech frequently going unchecked and unpunished. This 
same leaning towards openness and unfettered dialogue helped its 
platforms to grow exponentially - embracing all and any who wished 
to gather there to talk and perform. 


But now governments are taking steps to make online spacesmfer, 
more regulated, and more similar to their offline laws. Protected from 
hate speech on the street? Now you are on the net too... 
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are on the net too... 
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NETZDG vs DIGITAL HATE SPEECH 


Germany has some of the world’s toughest laws 
around hate speech, put in place after World War II. 
To ensure the same rules apply online, it created the 
controversial Network Enforcement Act. Often 
referred to as the "Facebook law," social media 
platforms like Facebook, Twitter, Youtube and Reddit 
can be fined up to €50 million for leaving posts 
classified as hate speech online for more than 24 
hours. 



// Insights Lab 


Governments, Media firms? 


backpage.com 


» aulo-truck-rv 


Governments are looking to media regulations for 
inspiration on how to control big tech 


Traditional national media, such as radio and newspapers, has always 
been beholden to rules and regulations. In the UK, for example, 
impartiality and the need to present breadth and diversity of opinion i 
a requirement of the BBC. For the most part, the internet has 
sidestepped much of this regulation. 


Yet, as users and governments recognise that our onlin, 
hold as much (if not more) sway over public opinion 
outcomes of elections, more people are asking 
'big media' in disguise?" 
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ALLOW STATES AND VICTIMS TO FIGHT 
ONLINE SEX TRAFFICKING ACT OF 2017 


After several families waged a legal battle against 
Backpage.com for its facilitation of child sex 
trafficking, American politicians moved to amend 
Section 230 Communications Decency Act. While the 
proposed amends only cover illegal content - the 
move would open the door to 'media company-like’ 
regulation online. Such a shift would redefine 
YouTube as we know it, and might do the same for 
Search and Reviews. 
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1. The importance of free speech 

2. Bad behaviour and censorship online 

3. Fighting back against bad behaviour online 

4. Tech firms - free speech or censorship? 

5. Flow do people want Google to respond to this predicament? 
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How are the tech firms responding? 


Google 
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Recognising the anxiety of users and governments, tech companies 
are adapting their stance towards censorship, and changing their 
terms of service to reflect the current mood. This could mean taking a 
more hardline approach to hateful content, as Twitter has done, or 
preventing the monetization of questionable videos, as YouTube has 
done . 

Whatsmore, companies are publicly declaring these new va 
making them as intrinsic to the platforms' identities qjjn^ 
unwavering support of freedom of expression on 
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TWITTER UNVERIFIED WHITE 
NATIONALISTS 

Twitter's new rules mean an account may be 
unverified if promotes, incites or engages in hate, 
violence or harassment. It revoked the verification of a 
number of prominent white nationalists, making their 


Tech firms. Tightening terms 


Tech firms have been tightening their terms of service 


social media accounts less powerful as a platform. 


The move enabled Twitter to disassociate itself with 


such voices without censoring specific forms of their 


Google 


content. 




Tech firms. Active curation 


Tech firms have been moving from passive facilitation 
to active curation 


In response to public outcries about the accessibility of unsavoury and 
harmful content, tech firms have been adjusting their software to 
make it harder to stumble upon it. Googles autocomolete blacklist 
means it's less likely that children will link to pornography while 
completing their biology homework. And by banning ads from payday 
lenders. Google also made it a little less likely that their parents would 
become entrapped by exorbitant interest fees. 

nfprmation, it's 
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Where once Google wished to organize the world's information, it's 
also long taken steps to protect users from the phishing and malwarJ 
they might encounter while looking for it. By ^Sking access to (or 
'quarantining') potentially harmful sites, Chrome and Search|;uide 
users away from threats (and stop traffic from flowing to flagged 
sites). 
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404 

AGE NOT FOUND 
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THE DAILY STORMER 

In the wake of violence in Charlottesville, internet 
domain registrar Go Daddy, Google and website 
security company Cloudflare ended their relationships 
with alt-right site The Daily Stormer, effectively booting 
it off the internet. While some free speech advocates 
were troubled by the idea that 'a voice' could be 
silenced at its source, others were encouraged by the 
united front the tech firms put up. 







Tech Companies, Moderation 


Tech firms have been amping up moderation 


Following a series of public and media outcries around problematic 
content online, such as the ' Peppa Pig scandal ', tech companies are 
slowly stepping into the role of moderator - one which they have long 
sought to avoid because of the associated responsibilities. 


e number 


Specifically, platforms are significantly amping up the numberof 
moderators they employ - in YouTube's case increasing th< 
of people on the lookout for inappropriate content to m 
10,000 . With Perspective, an API that uses machine learning to sfbt 
abuse and harassment online, Google's Jigsaw initiative is alro 
"studying how computers can learn to understand the nygWfces and 
context of abusive language at scale" 
moderators sort comments more effeo 
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" and finding ways to "help 
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YOUTUBE BANS POPULAR CHANNEL TO 
PROTECT KIDS 


Controversial kids 1 YouTube channel Toy Freaks, the 68th 
largest channel on the platform, was terminated by YouTube 
for "violating YouTube's Video Guidelines", presumably 
because some of the videos are potentially exploitative of 
the two children it features - showing them upset and in 
pain as well as in general gross-out situations. 
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Tech firms are performing a balancing act between two incompatible 

positions... 


Create unmediated 


'marketplaces of ideas 

100% commit to the American 
tradition that prioritises free speec 
for democracy, not civili 



By creating spaces where all values, 
including civility norms, are always 
open for debate 


Create well-ordered spaces 
for safety and civility 

100% commit to the European 
tradition that favors dignity over 
liberty, and civility over freedom 

By censoring racial and religious 
hatred, even when there's no 
provocation of violence 


Google 
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In the past, their position was clear 



Create unmediated 
'marketplaces of ideas 

“Neutral" 

"Aggregator" 

"Platform" 


Google 
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But tech firms have gradually shifted away from unmediated free speech and 

towards censorship and Moderation 



Create well-ordered spaces for 
safety and civility 


"Politicized" 

"Editor" 

"Publisher" 


Google 
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For a long time, we thought of censorship in terms of government and nation 
states, and I think now we're in an era in which people are starting to realise that 
private companies, probably mor^than ever before, control people's ability to 
amplify their voices, and whether or not their speech stays up or comes down, 

whfet they can listen to, what they can read. 

•V 

- Kalev Leetaru 
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Why the shift towards censorship? 


Create unmediated 
'marketplaces of 
ideas' 

In the absence of 



_W 

Create well-ordered 
spaces for safety 
and civility 

Appease users, 
maintain platform 
loyalty 

Respond to regulatory 

rules, bad behaviour 


Userdema. is 


thrived 

Governments were 
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expansion 

It's impossible to 
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Monetize content 

neutrally promote 
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' om nercial Demands 


through its organisation, 

content and info 
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increase revenues 

Advertisers were wary of 
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Protect advertisers from 

unintended placement 


Commercial Demands 

3 

controversial content, 

and endorsement 



r 

increase revenues 
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This new position as 'moderators in chief has been coming for some time... 


2008 

□— 


“As more and more speech migrates 
online, the ultimate power to 
decide who has an opportunity to 
be heard, and what we may say, 
lies increasingly with Internet 
service providers, search engines 
and other Internet companies like 
Google, Yahoo, AOL, Facebook and 
even eBay." 

Jeffrey Rosen, The New York Times 


2013 


"As online communication 
proliferates—and the ethical and 
financial costs of misjudgments 
rise— the Internet giants are 
grappling with the challenge of 
enforcing their community 
guideli 
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elines for free speech." 
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"We're witnessing a massive shift in 
the whole idea of the internet; from 
an open platform for the discussion 
of ideas to something that must 
be moderated and editorialised." 


Brendan O'Neill, The Spectator 


'sen, New Republic 


"The web is evolving from its roots 

as the anti-censorship platform of 
free speech and towards the very 
corporate-controlled moderated 
medium beholden to commercial 
and governmental interests that it 
rebelled against." 


Kalev Leetaru, Forbes 


Google 


// Insights Lab 









But users and their governments are questi 
responsibilities of tech firms liki 

2017 2018 


e censorial powers and 
ever before... 
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“Tech companies are under fire for 

creating problems instead of solving 
them. [Amazon, Google and Facebook] are 
making decisions about who gets a 
digital megaphone and who should be 
unplugged from the web. Their amount 
of concentrated authority resembles the 
divine right of kings, and is sparking a 
backlash that is still gathering force." 




People are no longer willing to see 
the platforms as neutral mediators 
^f social life. Whether it's 'fake news' 
or the knowledge of widespread 
behavioural targeting during elections, 
think there will be much more of a 
push to hold the platforms to 
account." 


David Streitfeld, The New York 


ng force. 
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Nathaniel Tkacz, 


Dazed and Confused 
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"It's unclear whether Facebook knows the extent of the collateral damage [that's 
coming from its censorship strategie^orthe oth^^npanies as well. But we do 
know that journalism, activism and public debate are being silenced in the effort 
to stamp out extremist speech. With these companies having so much power 
over the public discourse*They need to be held accountable. 


- Franklin Foer 
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Being critical of big tech's 
censorship powers was once a 
niche stance, coming mostly 
from those on the Right 


FRONTPAGE 


FACEBOOK THREATENS TO BAN 
CONSERVATIVE SITES IF THEY DISAGREE 
WITH THE LEFT 
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Google Search Results Ci 

The conclusions stoke a debate about the infl 



GOOGLE DOUBLES DOWN ON PURGING 
CONSERVATIVE SPEECH 



FINANCI^T 

al Media 

can no longer be allowed to 


But now, concern about big 
tech's 'abandonment of 
neutrality' has gone 
mainstream... 



SPECTATOR 

The internet’s war on free speech 

The web was meant to empower us all. Right now, it’s empowering 
censors 


Google 
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We've heard increasingly loud calls for media-esque regulations... 

Time to treat Google and Facebook as the 
media giants they really are 

CITYA.M. ^ ^ 




Media company or tech platform? The 
hugely important battle to redefine 
Facebook 


Google's identity crisis: Media or tech company at heart 
of ad row 

FACEBOOK’S 
OFFICIALLY A 
MEDIA COMPANY. 
TIME TO ACT LIKE 
ONE 
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Technology company? Publisher? The 
lines can no longer be blurred 

Guardian 
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while the platforms cling to Section 230 and re 

that lives on its pla 



BBC 


Google News boss: We're not a 
media company 

Why Facebook Won' 
It's a Media Com 

m Mo> 

Twitter Is Not a Media Compa: 

Says 


Mashable 

Google 



ced liability for the content 


Why is Silicon Valley fighting a sex 
trafficking bill? 

The 

Guaraian 


Anti-online sex trafficking bill gets 
crushed under Big Tech's lobbying 


•any, CEO 


THE 

HILL 
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The platforms' legal and moral demands create an unresolved tension 
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i' re medi 




The platforms have to deny that they're media companies in order to retain their 
immunity from liability. But at the same time, they're exercising more influence 
as media companies... than CBS News diddn its heyday, and therefore, in order 
for democratic values to flourish, they need to embrace free speech standards. 

/v\\/ 

- Jeffrey Rosen, Professor of Law at The George Washington University and legal 

affairs editor of The New Republic 1 
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1. The importance of free speech 

2. Bad behaviour and censorship online 

3. Fighting back against bad behaviour online 

4. Tech firms - free speech or censorship? 

5. Flow do people want Google to respond to this predicament? 


Google 
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The answer is not 'find 
the right amount of 
censorship' and stick to 

it... 


Google 


People vary in their opinion of how much censorship there 
should be online, often switching their position from issue to 
issue depending on the latest controversy, and there's no 
international consensus about how much censorial power the 
tech firms should enact either. 

Let free-speech thrive? Censor particular content and voices? 

Let governments decide? 

Whatever the chosen response, Google won't please everyone, 
norxan it hope to escape controversy or its responsibility for 
how society functions and progresses. 

Google might continue to shift with the times - changing its 
stance on how much or how little it censors (due to public, 
governmental or commercial pressures). If it does, 

acknowledgment of what this shift in position means for users 
and for Google is essential. Shifting blindly or silently in one 
direction or another rightly incties users' fury. 

Whatever pathway is taken - Google has an opportunity to make 
the most of it. 

Here are nine principles to kick-start the journey... 
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Be more 
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Don't take sides 


People are asking for equal treatment, regardless 
of politics or popularity 

HJterules^are invisible, and what makes it so complicated is that you 
know that there are rules, yet they seem to be arbitrarily applied. 

Why does Richard Spencer get booted from Twitter, yet Donald 
T rump managed to continue having a platform? ... I think there's this 
feeling that thegspace is being governed, yet the rules are not clear." 



Police tone instead of content 

People are asking you to oversee safe spaces 
that still encourage debate 


"My recommendation is to focus on regulating tone. If someone is 
threatening someone, regardless of the topic, that's something that 
a lot of people can agree has no place online. I think that's the least 
politically precarious situation. 'Hey, look, if you threaten someone's 
life, it gets pulled.' If you just argue with each other, that's fine." 


Kalev Leetaru 







Be more 


Justify global positions 


Enforce standards and policies clearly 


People are asking for clearer explanations of 
censorship policies and mechanisms - 
particularly when things go wrong 


"Muc 

inacc 

That 


oh ofsocial media's editorial guidelines are a black box, 
ccessible to the public since they belong to private companies, 
at lack ofjpansparency means it's unclear what factors go into 
the decision to take down a post." 

Cfoava Gourarie§Columbia Journalism Review 


lain the technology 


People are asking you to continue justifying your 
position regarding censorship in other markets 

"US-based IT monopolies are already tempted to comQromise 
themselves in order to gain entrance to these vast and fejj growing 
markets. The dictatorial leaders in these countries mayTH' only too 
happy to collaborate with them since they want to improve their 
methods of control over their own populations and expand their 
power and influence in the United States and the rest of the world." 



People are asking you to tell them more about how 
your technology actually works 


"For Google in particular [public confusion about how it works] is a 
huge problem, because the math behind autocomplete, and how the 
news feed and search are managed, are not only relatively obscure, but 
also change all the time. So, the short answer that Google gives about 
how the technology works is really not sufficient to the degree of 
anxiety people have about Google's centrality to how people receive 
their information." 


George Soros 
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responsive 


Improve communications 


People afe asking for more responsive customer 
service when it comes to censored content and 
complaints about bad behaviour online 



' need to be more transparent about their enforcement 
hanism, and they need to have clear grievance and appeal 
mechanisms/so people can get their content reinstated." 


Rebecca l^acKinnon, 'We Can Fight Terror without Sacrificing our 
Rig|fe' TED talk 1 



Take problems seriously 


People are asking for you to acknowledge the 
scope of problems in good time, and own up to 
your responsibilities as both a cause and a 
solution 


"As revelations have come out, they've come to seem not only 
inconsistent, but misguided and sometimes actively dishonest. I 
think lots of people don't believe it. They find it difficult to believe 
that Facebook didn't know the scale of the fake news problem as 
late as they did." 


Jason Pontin 






Positive guidelines 

People are asking for guidance on how to behave 
on your platform, rather than solely how not to 



"Face^jok, Twitter, and Google have never really expressed what 
their valdes are, or what they would like to see on their platforms... 

As 'bartenbem for a great global community' - they didn't do what 
every other hospitality organiser has done, in saying: 'We're this sort 
of place, this is the type of speech we would like to see here, and you 
are part of community when you join us. We hope you enjoy it and 
we hope that ^u make it pleasant for other people as well. Here are 
some ways that you can do that.'" 

ason Pontib 

Better signposts 

People are asking for empowering tools that help 
them identify contentious issues and content, 
rather than platforms that control conversations 

"If you think about someone searching, for example, 'iPhone 
rebooting', there probably is a limited diversity of what people are 
doing that for. Versus [searching for] 'Is Hillary the devil?' There's 
probably a little more diversity there, in terms of searches. Being 
able to search your way [through that] and to understand that certain 
things are more polarised [would be helpful]... People have no idea 
how much their inclinations are mediated." 

Kalev Leetaru 







Thank you. 

Explore more cultural insights at 
ao/culturalcontext 
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